Repository navigation
[GRDM-63966] waterbutler の依存先を RDM-waterbutler に変更し、共有する依存を更新(第2段階) - #10
Open
miyamoto83 wants to merge 231 commits into
Open
miyamoto83 wants to merge 231 commits into
miyamoto83 wants to merge 231 commits into
Conversation
* Add four new switches/envvars to manage keen logging:
* `KEEN_ENABLE_LOGGING` will turn on/off *all* keen logging.
* `KEEN_PRIVATE_LOG_VIEWS` will set logging for views to the
private collection.
* `KEEN_PRIVATE_LOG_ERRORS` will set logging for errors to the
private collection.
* `KEEN_PUBLIC_LOG_VIEWS` will set logging for views to the public
collection.
* The python module `certifi` was pinned to a very old version to work around issues with Rackspace. Not only is it no longer relevant, it can no longer successfully validate modern TLS certs
* conversion based off @aaxelb's work in @CenterForOpenScience/SHARE * update CI badge urls in README.md * add explicit upload to coveralls * replace python-coveralls with coveralls in dev-requirements.txt * remove old travis config files [ENG-3265]
* Allow the parent window of the MFR iframe to pass its own url when
starting the hypothes.is annotator. Parents using `postMessage`
must now send an object with two keys: `type: 'startHypothesis'`
and `parentUrl: <parent window url>`. Parents using pym must now
call `.sendMessage('setParentUrl', <parent window url>)`. The
included pym code has been updated to do this.
MFR overrides the annotator to pass the parent window's url rather
than its own, b/c the parent window url is more stable and
descriptive. It was previously doing this by calling
`document.referrer` from within the iframe. Due to privacy
concerns, browsers have started allowing the iframe to only see the
host and not the path of the parent url. Parent frames must now
pass in their own url to get around this.
* Upgrade Dockerfile image base to python v3.6. * Install gosu via apt-get. gosu v1.10 started being shipped with debian as of the `stretch` release. Install from apt-get instead of `curl`-ing it from the github release page. * Pin pip version to 18.1 to avoid dep conflicts. * Based off the following WB commits: * CenterForOpenScience/waterbutler@d03a84c * CenterForOpenScience/waterbutler@b179eb8
* Bump reportlab dep to v3.6.5 to unbreak `invoke install` on macOS.
* add boa to supported extensions * bump pygments dep to 2.12 to support boa * add debugging logs to codepygments extension
[ENG-12505]
… the Debian package instead of fetching it with keyserver verification, and exclude the report script from flake8 because it requires Python 3.6+
…/vuln-remediation, keeping the RDM CJK CMap files, the allow-modals iframe sandbox and the README lines unrelated to the Python 3.13 update
… runtime stages, move LibreOffice into a separate unoserver image (Dockerfile.unoserver) built on Ubuntu 26.04 because Debian 13 links LibreOffice against libxml2 2.9.14 whose open CVEs cannot be fixed there (the fixed 2.15 changed ABI) and without the unused pebble binary the Ubuntu base image ships, apply security updates, copy the nbconvert templates into the runtime image and verify the dependency tree with pip check
…age image and scan both the mfr and unoserver images with Trivy
…dt/ods with Japanese text) and run them in CI against the unoserver image
…cies: Pillow 13.0.0, mistune, Mako, nbconvert 7.17.2, psd-tools, Jinja2, Markdown, Pygments and ipython to versions with security fixes, propcache 0.5.4 (0.4.0 was yanked for a reference leak) and the unpinned transitive libraries (urllib3, pyasn1, soupsieve, bleach, idna, multidict) to their current releases; move black/isort/ruff to the dev group, port PSD export to PSDImage.open().composite() and drop the stray scikit-image test import
… of the original URL and keep the response open for streaming; add provider download tests
…Keen analytics when no project id is configured; add HTTP provider tests
…ar) and close it on shutdown instead of leaking a session per request
…s with asyncio.sleep so the event loop keeps serving requests, and give the worker its own control exchange so it does not receive pickle control messages from other applications sharing the broker
…e in the rst renderer)
…andlers only answer GET, but tornado parses form bodies before the method check
…nstead of the rpc backend, whose shared reply queue leaves results of earlier tasks unacknowledged until RabbitMQ closes the channel and the next task call fails; pin the default in a test
… 1.10.1 and prototype HTML pages under the pdf extension, and the GLmol/three.js files and the foundation/jquery-ui/qunit stylesheets under the pdb extension, none of which any template loads
… out since the extension was added in 2015, so .svg files are converted through unoconv and the extension's template and bundled SVGInjector 1.1.3-RC are never served
… Bootstrap 3.3.5 and jquery-mousewheel 3.1.13 in package.json, copy the served files from node_modules into the static directories with `invoke assets` during the Docker build instead of keeping copies in the repository (the server copy of the Bootstrap stylesheet was 3.3.4 and now matches the 3.3.5 script), and test that every file the templates load exists
…2.4.45 from npm together with the jquery.event.drag plugin it ships (the bundled 2.2 copy does not load under jQuery 3); replace the image viewer's removed load() event shorthand with on("load"), and check that the files the stylesheets refer to exist
…m npm (jQuery Zoom, pv with its gl-matrix build and JSC3D) in a CycloneDX SBOM so image scans see them, and test that the paths it records exist
…on 2 and invoke problems it describes cannot occur with the Poetry-based setup
…ull/101/head, 926e21f8) instead of the COS release tag and align the shared pins with it (aiohttp ^3.14, tornado 6.6, celery 5.6.3, sentry-sdk 2.73.0, newrelic 14.1.0, stevedore 5.9.1, google-auth 2.62.0, certifi 2026.10.23, setuptools ^84)
miyamoto83
marked this pull request as ready for review
November 13, 2026 03:38
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Ticket
GRDM-63966
Purpose
第 1 段階(#9)に続く第 2 段階。waterbutler の依存先を CenterForOpenScience/waterbutler 26.6.1 から RCOSDP/RDM-waterbutler の Python 3.13 対応ブランチに変更し、共有する依存をその固定版に揃えて、第 1 段階で残していた脆弱性を解消する。
本 PR は #9 のブランチの直上に 2 コミットを追加したもので、差分の大半は #9 と重複する。#9 が develop に入ると、本 PR の差分はその 2 コミット分(
pyproject.toml、poetry.lock)になる。Changes
feature/vuln-remediation(926e21f8)に変更した。pyproject.tomlは pull request ref(refs/pull/101/head)を指し、poetry.lockで 926e21f8 に固定している(13a19b5)。Side effects
QA Notes
feature/mfr-python313(282bffb)で、本ブランチと miya-biz/RDM-waterbutlerfeature/vuln-remediation(926e21f8)からビルドしたイメージを指定して実行。実行 43203342963 は失敗ジョブの再実行後に、WEKO 以外の 12 ジョブ中 9 成功。ファイルプレビューを含む User Tests は成功。失敗 3 件(Metadata、Wiki、Migration 20250906)は MFR / WaterButler を経由しない。Deployment Notes